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ABSTRACT 



According to one aspect of the disclosure, the present 
invention provides methods and arrangements for the 
removal or reduction of divergence artifacts between a 
transmitting codec and a receiving codec. One of a number 
of implementations includes using a deblocking filter in an 
inverse transformer loop and selectively disabling the filter 
upon certain conditions. 

13 Claims, 14 Drawing Sheets 
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DEBLOCKING FILTER FOR 
ENCODER/DECODER ARRANGEMENT AND 
METHOD WITH DIVERGENCE REDUCTION 

RELATED APPLICATIONS 

This is a continuatioa-in-part of U.S. patent application 
Ser. No. 09/064,397, filed on Apr. 22, 1998 (Docket No. 
8X8S. 208PA) which is a continuation-in part of U.S. patent 
application Ser. No. 09/098,106, filed Jun. 16, 1998, which 
is a continuation of U.S. patent application Ser. No. 09/005, 
053, filed Jan. 9, 1998, which is a continuation-in-part of 
U.S. patent application 08/908,826, filed on Aug. 8, 1997 
(now U.S. Pat. No. 5,790,712), which is a continuation of 
U.S. patent application Ser. No. 08/658,917, filed on May 
31, 1996 (now abandoned), which is a continuation of U.S. 
patent application Ser. No. 08/303,973, filed Sep. 9, 1994 
(now abandoned), which is a continuation of U.S. patent 
application Ser. No. 07/838,382, filed Feb. 19, 1992, now 
U.S. Pat. No. 5,379,351. 

FIELD OF THE INVENTION 

The present invention relates to data compression and 
decompression in an encoding/decoding system. The present 
invention has particular application for image coding/ 
decoding systems where communicating terminals employ 
reconstruction algorithms based on previously decoded 
images. 

BACKGROUND OF THE INVENTION 

Videocommunication equipment, such as videoconfer- 
encing systems and videophone devices, have enabled 
people to communicate visually without having to travel to 
a common location. As a result, communication participants 
can be separated by large distances. 

A typical videoconferencing uses a video camera to 
capture a series of images of a target, such as a meeting 
participant or a document. The series of images is encoded 
as a data stream and transmitted over a communications 
channel to a remote location. For example, the data stream 
may be transmitted over a phone line, an integrated services 
digital network (ISDN) line, or the Internet. The encoding 
process is typically implemented using a digital video coder/ 
decoder (codec), which divides the images into blocks and 
compresses the blocks according to a video compression 
standard, such as the H.263 and H.261 recommendations by 
the Telecommunication Standardization Sector of the Inter- 
national Telecommunication Union (ITU-T). In standards of 
this type, a block may be compressed independent of the 
previous image or as a difference between the block and part 
of the previous image. 

In a typical videoconferencing system, the data stream is 
received at a remote location, where it is decoded into a 
series of images, which may be viewed at the remote 
location. Depending on the equipment used, this process 
typically occurs at a rate of one to thirty frames per second. 

In some videoconferencing applications, it is desirable to 
transmit a high quality still image. Until the image is 
completely received and decoded, the receiving terminal is 
often unaware of its content. Some decoders decode and 
display a block only after they have received the complete 
image. With the image being transmitted as a series of 
blocks, considerable delay is often involved in transmitting 
the entire image. For example, in applications where the 
available bandwidth for transmitting data is small, transmis- 
sion of a 352x288 pixel image may require up to a minute. 
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In order to transmit still images more quickly, the image may 
be highly compressed. 

The above-mentioned Telecommunication Standardiza- 
tion Sector recently revised ITU-T H.263 recommendation 

5 by appending thereto Annex J: Deblocking Filter Mode. This 
annex describes an optional loop filter (also referred to as as 
block edge filter or deblocking filter) to be used within the 
prediction loop used for coding in each of the send and 
receive terminals in image communicating system. The 

10 main purpose of the loop filter is to reduce blocking artifacts. 
Such artifacts often appear at boundaries between different 
image blocks. The above-mentioned annex, not unlike other 
recommendations by the ITU, was adopted after much 
research and consideration for the purpose of providing 

15 communicating image terminals of various types and manu- 
facturers the ability to communicate images accurately. 

In connection with the present invention, a significant 
discovery has been made. After intense research, it has been 
discovered that respective implementations of two image 

20 communication terminals, each fully compliant with the 
above-mentioned annex to the ITU-T H.263 recommenda- 
tion result in visually apparent artifacts which result from 
divergence between sending and receiving terminals. Such 
artifacts appear as long as the loop filter portion of Annex J 

25 is used, irrespective of whether the other portions of Annex 
J (Unrestricted Motion Vectors, 4MV) are also used. The 
response by the ITU-T was one of surprise. 

SUMMARY OF THE INVENTION 

30 

Generally, the present invention provides methods and 
arrangements for the removal or reduction of divergence 
artifacts between the transmitting codec and the receiving 
code. In one general embodiment of the invention, a method 

35 for transmitting a representation of an image from a first 
terminal to a second terminal uses a communications chan- 
nel on which communication has been established between 
the first terminal and the second terminal. The method 
operates each of the first and second terminals using an 

40 inverse transformer loop having a decoding algorithm that 
accumulates at least one error, and selectively uses a loop 
filter in the inverse transformer loop based on at least one 
predetermined condition. In a more specific embodiment, 
the predetermined condition includes at least one of: sur- 

45 passing a quantization parameter threshold; and processing 
chroma channel data. 

In another method embodiment, the present invention 
provides a method for encoding and decoding a represen- 
tation of an image for communication between a first 

50 terminal to a second terminal. The method comprises: oper- 
ating each of the first and second terminals using an inverse 
transformer loop having a decoding algorithm; and prevent- 
ing unacceptable accumulation of an error within the inverse 
transformer loop by at least one of: pre-processing input data 

55 before using the inverse transformer loop to process the 
input data; using the inverse transformer in the loop accord- 
ing to a bit-exact specification between the encoder and 
decoder in the resepctive first and second terminals; using 
the inverse transformer in the loop according to one of a 

60 plurality of bit-exact specifications between the encoder and 
decoder in the respective first and second terminals and 
negotiating a common decision on the particular specifica- 
tion through encoder/decoder negotiation; providing a quan- 
tization value in the inverse transformer loop that takes into 

65 account that the effect of the quantization values on loop 
filter divergence so as to be less prone to divergence; 
adjusting or providing transform coefficients to limit diver- 
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gence; choosing an encoding mode for macro-blocks of 
input data; modifying the encoder to refresh portions of the 
image that are diverging; modify the loop filter character- 
istics so that inverse transform mismatches are not ampli- 
fied; applying the loop filter to input data corresponding to 
a frame buffer image just before sending to a display circuit 
without writing back the results to a frame buffer in the loop. 

Certain other aspects of the invention are directed to 
encoding and decoding equipment and circuits constructed 
and arranged to operate according to the above methodol- 
ogy. 

The above summary is not intended to characterize each 
embodiment of the present invention. Other aspects of the 
present invention will become apparent upon review of the 
figures and corresponding "Detailed Description". 

BRIEF DESCRIPTION OF THE DRAWINGS 

Various aspects and advantages of the present invention 
will become apparent upon reading the following detailed 
description of various embodiments and upon reference to 
the drawings in which: 

FIG. 1 illustrates a videoconferencing system implement- 
ing an embodiment of the present invention; 

FIGS. 2, 2A and 2B illustrate in block diagram form 
various additional embodiments of an encoding arrangement 
according to the present invention; 

FIG. 3 illustrates in block diagram form an embodiment 
of a decoding arrangement, according to the present 
invention, that is useful for decoding images sourced from 
the encoding arrangement of FIG. 2 and generally consistent 
with other ones of the illustrated encoding/decoding meth- 
ods and processes discussed below; 

FIG. 4 illustrates in block diagram form another embodi- 
ment of an encoding arrangement according to the present 
invention; 

FIG. 5 illustrates in block diagram form another embodi- 
ment of an encoding arrangement according to the present 
invention; 

FIG. 6 illustrates in block diagram form another embodi- 
ment of an encoding arrangement according to the present 
invention; 

FIG. 7 illustrates in block diagram form another embodi- 
ment of an encoding/decoding arrangement according to the 
present invention; 

FIGS. 8A and 8B illustrate in graphic form characteristics 
of respective transform loops according to particular 
embodiments of the present invention; and 

FIG. 9 illustrates in block diagram form another embodi- 
ment of an encoding/decoding arrangement according to the 
present invention. 

While the invention is amenable to various modifications 
and alternative forms, specifics thereof have been shown by 
way of example in the drawings and will be described in 
detail. It should be understood, however, that the intention is 
not to limit the invention to the particular embodiment 
described. On the contrary, the invention is to cover all 
modifications, equivalents, and alternatives falling within 
the spirit and scope of the invention as defined by the 
appended claims. 

DETAILED DESCRIPTION 

The present invention is believed to be applicable to a 
variety of systems and arrangements that transmit and 
decode compressed images. The present invention has been 
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found to be particularly advantageous in videoconferencing 
applications in which the reconstruction algorithms of the 
compressor encoder and compressor decoder are not iden- 
tical. A particular example application is an application 
5 intending to be compliant with the ITU-T H.263 Annex J 
recommendation where the accuracy of the prediction opera- 
tion at the communicating terminals is defined using statis- 
tical data, rather than a bit -exact or operation-specific meth- 
odology at both ends. While the present invention is not 
necessarily limited to such applications, an appreciation of 
various aspects of the invention is best gained through a 
discussion of example arrangements operating in this type of 
application. 

In connection with the present invention, it has been 

15 discovered that the nature of the ITU-TH.263 Annex J 
recommendation permits the accumulation of seemingly 
negligible differences between transmitting codec's predic- 
tion frames and the receiving codec's prediction frames, 
therefore resulting in significant distortion of the receiving 

2Q codec's decoded images. This occurs even though mis- 
matched inverse transformations, in this case IDCTs, are 
compliant according to ITU-T H.263 Annex A ("Inverse 
Transform Accuracy Specification"). 

The problem can be best understood by referring to an 

25 example image-communication system, such as the video- 
conferencing system 10 of FIG. 1 and the other illustrated 
encoding and decoding arrangements. 

FIG. 1 illustrates an example videoconferencing system 
10 particularly suited for use in connection with the present 

30 invention. A first videoconferencing station 12 includes a 
first terminal 14 that receives images from a camera 16. The 
images are processed by a codec in the terminal 14 and are 
transmitted over a communications channel 20. For 
example, the images may be transmitted over a telephone 

35 line, an ISDN line, an Internet channel, or a similar com- 
munications network. The images are then received by a 
second videoconferencing station 22, including a second 
terminal configured to be compatible with the first terminal. 
To facilitate the discussion below, the first and second 

40 terminals 14 and 24 are respectively referred to as local and 
remote terminals. It should be understood, however, that the 
features described can be incorporated into either or both 
terminals. The remote videoconferencing station 22 may 
further include a camera 26 and a codec 28. The remote 

45 videoconferencing station 22 receives the images over the 
communications channel 20 from the local videoconferenc- 
ing station 12 and decodes them using the codec 28. The 
decoded images may be displayed on a display monitor 30. 
In this manner, meetings can be conducted, for example, 

50 with participants separated by long distances with all meet- 
ing participants able to see each other. 

FIG. 2 illustrates another embodiment of an encoding 
arrangement 300 that is particularly suited for use in the 
present invention. An original image is stored in a memory 

55 301, such as a frame buffer. The original image is received 
by a summing element 302, which is configured and 
arranged to calculate difference information representing the 
difference between the original image and an image stored 
in a memory 304, such as a frame buffer. When no image is 

60 initially stored in the memory 304, the original image is 
passed to a transformation block 306, which transforms the 
image into coefficient data selected from a continuous range 
of values. In the illustrated example, the transformation 
block 306 performs a discrete cosine transform (DCT) on 

65 the original image. To encode a stream of images, the 
original image is replaced with successive frames after 
encoding each frame. 
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The coefficient data is further transformed by a transfor- 
mation block, illustrated as a quantizer 308, which is con- 
trolled by a coding control block 310. The quantizer 308 
maps the coefficient data to a discrete set of values by 
dividing the continuous range of values into a set of non- 
overlapping subranges. Each subrange is mapped to a single 
value, such that whenever a coefficient falls within a given 
subrange, the quantizer 308 generates the corresponding 
discrete value. The size of the subranges and the quality of 
the quantization are controlled by the coding control block 
310. 

The quantized data thus generated is encoded by an 
encoding block, illustrated as a Huffman encoder 312. For 
example, the quantized data may be encoded as a run length 
vector. The encoded data is stored in a memory 314 for 
transmission over a communications channel 316. 

The quantized data is also received by a transformation 
block 318. The transformation block 318, implemented as an 
inverse quantizer in the illustrated example, maps the quan- 
tized data to a continuous range of values. The quality of the 
inverse quantization is controlled by the coding control 
block 310. A second transformation block 320 further trans- 
forms the quantized data using an inverse discrete cosine 
transform (IDCT) to reconstruct the image as it would be 
seen at a remote videoconferencing station. 

Using a loop filter 303 to smooth out transitions at image 
block boundaries, the reconstructed image is incorporated 
into the image previously stored in the memory 304 by a 
summing element 322, and the image thus produced is 
stored in the memory 304 as the new reference frame for 
encoding the next frame. The memory 304 provides the 
reconstructed image to the summing element 302, and the 
process is repeated, either by continuing to encode succes- 
sive frames of video, or by progressively improving a single 
still image. 

FIG. 2A illustrates another example embodiment of a 
decoding arrangement 350. The functional blocks illustrated 
in FIG. 2A correspond and perform as described in connec- 
tion with the corresponding blocks of FIG. 2, with certain 
exceptions relating to the coding control block 310 of FIG. 
2. In FIG. 2A, the coding control block 310' is used not only 
to control the quality of the quantization and inverse quan- 
tization as discussed in connection with FIG. 2, but also to 
determine when the characteristics of the incoming data 
merit use of the deblocking filter 303' of FIG. 2A. In 
accordance with the present invention, it has been discov- 
ered that divergence can be reduced by disabling the 
deblocking filter for those frames with picture or average 
quantizations that are less than a selected threshold. 

Further, in connection with the present invention it has 
been discovered that the perceptual advantage provided by 
the deblocking filter is present only at higher quantizations. 
For example, the perceptual advantage provided by the 
deblocking filter is present when the quantization parameter 
(PQUANT) is at least five. Accordingly, in the example 
decoding arrangement 350 of FIG. 2A, the coding control 
block 310' is coupled to an enable/disable port of the 
deblocking filter 303'. The coding control block 310' uses a 
comparator block 315 to determine whether or not 
PQUANT is less than the selected threshold, "five" in this 
instance. Hie selected threshold is checked on a frame -by- 
frame basis (after encoding each frame) or, alternatively, 
using an average of a number of previously coded frames. In 
a particular embodiment, several previously coded frames 
are used to form the average. Using this data flow 
arrangement, the coding control block 310' monitors 
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PQUANT and uses the average PQUANT value over some 
number of frames in order to compare with the threshold. 
This provides for less-frequent enable/disable transitions for 
the deblocking filter. 

5 Any of the above-described embodiments of FIG. 2A is 
advantageous because each realizes a significant reduction 
in both divergence artifacts and computation. 

FIG. 2B illustrates yet another example embodiment of a 
decoding arrangement 370 in which a deblocking filter 303" 

10 includes an enable/disable port controlled by a channel 
selector 372. The channel selector 372 includes conven- 
tional channel selection addressing for sequentially selecting 
the hima channel and chroma channels for each frame in the 
memory 301. In addition, the channel selector 372 disables 

15 the deblocking filter 303" when the chroma channels of the 
memory 301 are selected for encoding. This implementation 
realizes an elimination of prominent divergence artifacts, 
including a lack of significant blockiness. Although luma- 
based divergence artifacts remain, such artifacts are much 

20 less severe than chroma-based artifacts. 

Alternatively, the processing of the luma and chroma 
channels for each frame in the memory 301 is performed on 
a parallel-path basis (hot shown), rather than the above- 

2S described sequential or alternating luma/chroma channel 
processing method. In this alternative implementation, a 
deblocking filter is used only for the portion of the encoding 
arrangement that encodes the luma channel data, and not for 
the portion of the encoding arrangement that encodes the 

3Q chroma channel data. 

According to other example embodiments of the present 
invention, two or more of the above criteria are used at the 
same time to minimize and/or remove divergence artifacts in 
the encoding arrangement. In one implementation, for 

35 example, the deblocking filter is disabled when PQUANT is 
less than the selected threshold and/or when chroma channel 
data is being encoded. 

FIG. 3 illustrates another example embodiment of a 
decoding arrangement 400, also including a loop filter like 

40 the loop filter of FIG. 2, that is also particularly suited for use 
in the present invention. A data stream received over a 
communications channel 402 is stored in a memory 404, 
implemented as a buffer in the illustrated example. A 
decoder, illustrated as a Huffman decoder 406, decodes the 

45 data stream into image data and provides the image data to 
a transformation block 408. The transformation block 408, 
implemented as an inverse quantizer in the illustrated 
example, maps the image data to a continuous range of 
values. A second transformation block 410 further trans- 

50 forms the continuous value using an inverse discrete cosine 
transform (IDCT) to reconstruct the difference information 
received from the local terminal. A summing element 414 
integrates the difference information into the image previ- 
ously stored in a memory 412, depicted as a frame buffer, 

55 and the image is filtered by a loop filter 411 (constructed 
similar to the loop filter 303 of FIG. 2). The image thus 
produced is stored in the memory 412 and displayed by a 
display device 413. Additional data received over the com- 
munications channel 402 is integrated into the stored image 

60 to improve its quality. 

It has been discovered in connection with the present 
invention that visually apparent divergence artifacts occurs 
and that the visual artifacts worsen over time when the 
ITU-T H.263 Annex J loop filter is used in the case where 

65 the encoder IDCT differs from the decoder IDCT. Differ- 
ences between sending codec and receiving codec IDCTs 
may arise due to difference in how many bits of precision are 
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used in the arithmetic operations of the specific implemen- 
tation of the IDCT, even though both IDCTs are H.263 
Annex A compliant. Furthermore, the artifacts do not occur 
if the loop filler is turned off. It is therefore likely that the 
loop filter may enhance the mismatch between encoder and 
decoder IDCT. 

To reproduce these described divergence artifacts, refer- 
ence may be made to document Q15-D-41 submitted to the 
ITU-T Study Group 16 (paper dated Apr. 13, 1998). These 
divergence artifacts were discovered using the following 
setup: 

Encoder: UBC encoder tmn-3.1.2 using their floating point 
IDCT, with Annex J enabled. For simplicity, only enable 
loop filter with Annex J, and keep unrestricted motion 
vector mode and four motion vector modes OFF. 
>tmn -i rawseq -B bs-q I-a 0 -b 99 -q 2 -A 2 -k 0 -1 

Decoder: UBC decoder tmndec-3.1.2 using a modified 
fixed-point IDCT. The fixed-point IDCT was modified to 
make it H.263 Annex A compliant and is listed in Appen- 
dix A. 

>tmndec -o4 -x -1 bs-q I -j 
Test sequence: A one hundred frame natural sequence show- 
ing a stationary color grid is included in a file entitled 
"rawseq" as discussed in the above-referenced paper 
submitted to the ITU-T. 

The above simulations were used on the included dataset 
for QP values ranging from 1 to 31. Included in 
ql5d41ab.tar.gz are coded bitstreams where Annex J is both 
on and off (bs-ql-j, bs-ql), with QP-1. 

For low QPs (0<QP<5), obvious divergence patterns 
appear along edges. For QP=1 (bs-ql-j) a vertical line along 
the right edge of the yellow patch, as well as spots along the 
8x8 block boundaries in the lower right blue patch appear. 
When QP is increased, the patterns become blurred, but 
divergence patterns are still noticeable along the edges of the 
green center-low patch and the blue right-low patch up to 
QP=4. 

Note that the INTRA MB refresh rule (threshold =132 
coded MBs) does not prevent artifacts with the test sequence 
since the threshold is not reached. In general, even if the 
threshold is reached, divergence may have already leaked 
into other MBs under the following conditions: (1) uncoded 
blocks that border coded blocks are filtered based on the 
pixels in the coded blocks; these uncoded blocks are not 
fixed by the refresh since their threshold are never triggered; 
and (2) MVs of neighboring MBs may reference areas of 
divergence, the neighboring MBs are not fixed by the refresh 
if they stop referencing the refreshed MB. 

Condition (1) is specific to the loop filler and gives rise to 
an interesting scenario. Refreshing a MB may not even fix 
divergence within the refreshed MB since the loop filter may 
immediately pull in divergence errors just outside the MB 
boundaries. 

The observed visual artifacts indicate that the loop filter is 
not stable in a control sense; i.e., a small difference in the 
encoder/decoder is amplified by the filter. This amplification 
is demonstrated for a specific range of the filter in the 
following example. 

The deblock equations arc: 

Bi-cIip(B+dI) 
Cl-clip{C-di) 
Al-A-d2 
DI-D+dl 

d-(A-4B+4C-D)/g 
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dJ-UpDo*nRamp{d, STRENGTH) 
<a-clipd I«A-Dy4, d W) 

Consider the case where A=D, and for simplicity no 
clipping is required. Then the equations are: 

a=c-di 

Al~A 

d-(C-B)fl 

dI-UpDownRainp((C-B)!2 t STRENGTH) 

Note that only B and C gel updated by the deblock filter. 
Assume the encoder has 

a-B'>o 

and the decoder has 

C-B">Q 

and that there is a slight encoder/decoder IDCT mismatch 
such that 



30 



(C - B 0 ) -(C* -B') = A>0 
2d" 2ef 



40 



If these (d 1 , d") are in the negative slope range of the 
35 UpDownRamp, then di'>di\ Now since 



CT-BV-iC'-Bj-ldV 

Cr-BI'=(C'-B")-2dl" 

the encoder/decoder mismatch after the deblock filter will 
be: 

At(cr-Bi*y(cr-Br) 

{C-B^-iC'-B^-ldr^dVA+W-di") 

The quantity (dl'-dl") is positive and therefore 
Al>A 

which implies that the filter amplifies the encoder/decoder 
mismatch. 

The present invention addresses this discovered problem 
using one or more of the embodiments that are discussed 
below. 

According to one implementation, the present invention 
provides a method for encoding and decoding involving the 
use of an inverse transform that is specified bit-exactly in 
encoder and decoder. For example, the encoding/decoding 
arrangement of FIGS. 2 and 3 provide this approach, using 
a specified bit-exact match. This avoids encoder/decoder 
inverse transform mismatch, thereby eliminating divergence 
artifacts. 

According to another implementation, the present inven- 
65 tion provides a method for encoding and decoding involving 
the use of an inverse transform that is specified bit -exactly 
in encoder and decoder, as described above, but the inverse 
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transform is selected at the run-time from a set of available 
inverse transforms. The comuni eating terminals then nego- 
tiate to reach a common inverse transform so that encoder/ 
decoder inverse transforms are matched, thereby eliminating 
divergence artifacts. FIGS. 2 and 3 illustrate an alternative 5 
encoding/decoding arrangement, according to the present 
invention, using an optional inverse transform selector at 
each end to provide the appropriate matching. 

According to another implementation, the present inven- 
tion provides a method for encoding and decoding involving 10 
the step of pre-processing image data before encoding in the 
loop. For example, by applying a filter to the entire image, 
or selectively in regions that may give rise to divergence 
artifacts, any potential inverse transform mismatch from 
being significantly enhanced by the loop filter is prevented 15 
to reduce divergence artifacts. Such an implementation is 
shown in FIG. 4, where the input data supplied by the 
camera 450 is filtered at filter 452 before presentation to the 
encoder 454 to avoid divergence build-up. 

According to another implementation, the present inven- 20 
tion provides a method for encoding and decoding involving 
the use of a modified encoding arrangement to reduce errors. 
Example implementations include one or more of the fol- 
lowing: an encoding arrangement that selects a quantization 
value which is less prone to divergence; an encoding 25 
arrangement that adjusts transform coefficients to limit 
divergence; an encoding arrangement that adjusts the encod- 
ing mode decision for macroblocks; and an encoding 
arrangement that uses combinations of the above 
approaches. Such an implementation is shown in FIG. 5, 30 
where an anti-divergence encoding adjustment block 460 is 
used to provide one or more of these adjustments or selec- 
tions. 

As shown by way of example in the encoding arrange- 
ment of FIG, 6, another embodiment of the present invention 35 
involves the encoding arrangement determining at block 470 
which portions of the image are diverging. The portions are 
INTRA coded (refreshed) to terminate any divergence. The 
refresh is accomplished by coding the regions in INTRA 
mode, with no dependencies on previous reference data. 40 

In yet another embodiment of the present invention and as 
shown by way of example in FIG. 7, a conventional encod- 
ing arrangement is modified as above to refresh portions of 
the image that are diverging and coding the regions in 
INTRA mode, but based on information conveyed from the 45 
decoder via a feedback channel, such as a channel 472 
carrying control data between encoder refresh controller 474 
and decoder deblocking feedback controller 476. The infor- 
mation may include, for example, copies of the decoder's 
reference frame at a particular time, or portions thereof. This 50 
similarly terminates divergence artifacts before they become 
significant. 

According to another implementation and as shown by 
way of example in FIGS. 8Aand 8B, the modified set of loop 
filter characteristics shown in FIG. 8B are used rather than 55 
the ITU-T set of FIG. 8A so that inverse transform mis- 
matches are not amplified. One or more of the loop filter 
equations, the strength table, and the definition of the 
UpDownRamp curve, are adjusted to reduce loop filter 
amplification of inverse transform mismatch. 60 

In another embodiment, the encoding arrangement is 
adaptively modified depending on the motion in the scene. 
A more particular embodiment involves such adaptive modi- 
fication applied non-uniform ly to luma and chroma compo- 
nents of the image data. In an alternative particular 65 
embodiment, such adaptive modification is applied uni- 
formly to luma and chroma components of the image data. 



10 

Using either of these particular implementations, the adjust- 
ments to the encoder behavior reduce divergence artifacts. 

According to yet another implementation implementation 
and as shown by way of example in FIG. 9, the loop filter 
is applied to the frame buffer image just before sending the 
data to a display circuit, but the results are not written back 
to the frame buffer. This moves the loop filter out of the 
codec loop and preserves some of the benefits of deblocking, 
but any deblocking amplification of inverse transform mis- 
match is not fed back to avoid error build up and to eliminate 
divergence artifacts. 

Accordingly, the present invention provides various 
implementations that solve a significant problem discovered 
in connection herewith. According to particular 
implementations, an encoding/decoding method and 
arrangement uses an inverse transform loop having a decod- 
ing algorithm that: is susceptible to accumulating error due 
to inverse transformer mismatch with the method and 
arrangement providing control to maintain the accumulation 
below an acceptable threshold; and/or eliminates the possi- 
bility of such an error being accumulated within the loop. 

For further information concerning the construction and 
operation of the encoding and decoding components and 
blocks illustrated in connection with the figures, reference 
may be made to U.S. patent application Ser. No. 08/944,311, 
filed Oct. 6, 1997, and No. 09/005,053, filed Jan. 9, 1998 
(Docket Nos. 11611.14USI1, and 11611.51US01), incorpo- 
rated by reference in their entirety. 

The various embodiments described above are provided 
by way of illustration only and should not be construed to 
limi t the invention. Those skilled in the art will readily 
recognize various modifications and changes which may be 
made to the present invention. For example, various ones of 
the above approaches to eliminating or reducing artifacts are 
compatible and can therefore be combined. Such modifica- 
tions may not strictly follow the above discussion of the 
exemplary embodiments and applications. However, these 
modifications do not depart from the teaching, or the true 
spirit and scope, of the present invention. The invention is 
set forth in the following claims. 

What is claimed is: 

1. A method for transmitting a representation of an image 
from a first terminal to a second terminal using a commu- 
nications channel, comprising: 

operating each of the first and second terminals using an 
inverse transformer loop having a decoding algorithm 
that accumulates at least one error, and 

selectively using a loop filter in the inverse transformer 
loop based on at least one predetermined condition. 

2. A method, according to claim 1, wherein said at least 
one predetermined condition includes at least one of: sur- 
passing a quantization parameter threshold; and processing 
chroma channel data. 

3. A method, according to claim 1, wherein said at least 
one predetermined condition includes a quantization param- 
eter threshold approximately equal to 5. 

4. A method, according to claim 3, wherein said quanti- 
zation parameter threshold being equal to 5 corresponds to 
an average of several quantization parameters. 

5. A method, according to claim 1, further including 
refreshing. 

6. A method for encoding and decoding a representation 
of an image for communication between a first terminal and 
a second terminal, comprising: 

operating each of the first and second terminals using an 

inverse transformer loop; and 
preventing unacceptable accumulation of an error within 

the inverse transformer loop by at least one of: pre- 



03/18/2004, EAST Version: 1.4.1 



6,160,503 



11 



12 



processing input data before using the inverse trans- 
former loop to process the input data; using the inverse 
transformer in the loop according to a bit-exact speci- 
fication between the encoder and decoder in the respec- 
tive first and second terminals; using the inverse trans- 
former in the loop according to one of a plurality of 
bit-exact specifications between the encoder and 
decoder in the respective first and second terminals and 
negotiating a common decision on the particular speci- 
fication through encoder/decoder negotiation; provid- 
ing a quantization value in the inverse transformer loop 
that is less prone to divergence; adjusting or providing 
transform coefficients to limit divergence; choosing an 
encoding mode for macro-blocks of input data; modi- 
fying the encoder to refresh portions of the image that 
are diverging; modifying the loop filter characteristics 
so that inverse transform mismatches are not amplified; 
applying the loop filter to input data corresponding to 
a frame buffer image just before sending to a display 
circuit without writing back the results to a frame buffer 
in the loop; selectively using a loop filter in each 
inverse transformer loop based on at least one prede- 
termined condition. 

7. A method, according to claim 6, wherein said at least 
one predetermined condition includes at least one of: sur- 
passing a quantization parameter threshold, and processing 
chroma channel data. 

8. An image communication terminal having a circuit 
constructed and arranged to operate according to claim 6. 

9. An image communication terminal having a circuit 
constructed and arranged to operate according to claim 1. 

10. An image communication terminal having a circuit 
constructed and arranged to operate according to claim 2. 

11. An image communication terminal having a circuit 
constructed and arranged to operate according to claim 3. 

12. For communicating a representation of an image 
between a first terminal and a second terminal using a 
communications channel, an arrangement in at least one of 
the terminals, comprising: 



means for operating the terminal using an inverse trans- 
former loop having a decoding algorithm that accumu- 
lates at least one error, and 

means for selectively using a loop filter in each inverse 
5 transformer loop based on at least one predetermined 
condition. 

13. For communicating a representation of an image 
between a first terminal and a second terminal using a 
communications channel, an arrangement in at least one of 
10 the terminals, comprising: 

means for operating the terminal using an inverse trans- 
former loop; and 
means for preventing unacceptable accumulation of an 
error within the inverse transformer loop by at least one 
15 of: pre-processing input data before using the inverse 
transformer loop to process the input data; using the 
inverse transformer in the loop according to a bit -exact 
specification between the encoder and decoder in the 
respective first and second terminals; using the inverse 
transformer in the loop according to one of a plurality 
of bit-exact specifications between the encoder and 
decoder in the respective first and second terminals and 
negotiating a common decision on the particular speci- 
fication through encoder/decoder negotiation; provid- 
ing a quantization valuer in the inverse transformer 
loop that is less prone to divergence; adjusting or 
providing transform coefficients to limit divergence; 
choosing an encoding mode for macro-blocks of input 
data; modifying the encoder to refresh portions of the 
image that are diverging; modifying the loop filter 
characteristics so that inverse transform mismatches 
are not amplified; applying the loop filter to input data 
corresponding to a frame buffer image just before 
sending to a display circuit without writing back the 
results to a frame buffer in the loop; selectively using 
a loop filter in each inverse transformer loop based on 
at least one predetermined condition. 
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